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METHOD AND APPARATUS FOR DYNAMIC OPTIMIZATION OF A MULTI- 
SERVICE ACCESS DEVICE 

BACKGROUND 

1. Field of the Invention 

This invention relates to communication systems. In particular, the invention relates 
to the field of transmitting data over data networks, and more particularly, to a method and 
apparatus for the dynamic optimization of a multi-service access device in response to the 
current mix of data traffic being presented to the multi-service access device. 

2. Description of the Related Art 

Telecommunications, which has historically only been involved with analog voice 
and fax connectivity, is increasingly merging with data communications/data networking, 
which has historically only been involved with digital data connectivity. The merging of the 
telecommunications and data communications environments has occurred because of the 
emergence of the Digital Signal Processor (DSP). DSPs allow voice, video, fax and other 
analog signals to be processed into a variety of digital formats. With the right software, a 
DSP can convert analog voice and fax into digital data for transport over data networks. 
Because DSPs have fallen substantially in price, the development of new types of hybrid 
networking environments- voice/data integrated networks- are rapidly being developed. This 
sort of functionality has been incorporated in routing/switching devices that connect a 
plurality of networks to one another and further perform forwarding of packets between the 
connected networks. Today, multi-access service devices, such as multi-access 
routers/switches, integrate voice, video, and data for transmission across connected networks. 
It is particularly important that these voice/data integrated networks transport voice/data 
packets or cells as reliably and efficiently as possible. 

Unfortunately, data traffic and voice traffic routed through a multi-service access 
device have conflicting requirements and the optimizations presently used to handle them are 
effectively at odds with one another. For example, voice traffic needs low latency and high 
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reliability. Particularly, for voice transmission and reception to be effective over a data 
network voice packets need to be received and transmitted consecutively with high reliability 
(i.e. minimal loss) and with very little delay (i.e. minimal latency and interrupts). Latency, in 
the receipt of voice packets causes echoes and delays. Further, when voice packets are lost, 
the actual real time voice conversation is likewise lost, which is unacceptable. Therefore, 
multi-service access devices that are statically optimized for voice typically interrupt lower 
priority tasks (e.g. data traffic processing) to allow for the consecutive processing of voice 
packets. Ac-^^ 

On the other hand, latency and reliability are not that^great of a concern to the 
processing of data traffic. In the processing of data traffic, if a packet is delayed or lost, it is 
not that important because it can just be resent and then utilized; as opposed to a real time 
operation such as a voice conversation. The more important criterion for the processing of 
data traffic is high throughput. Efficient data processing requires large amounts of 
uninterrupted processing time where the multi-service access device can process large 
volumes of data traffic while taking advantage of high speed cache memory and repetitive 
operations. This results in great increases in efficiency for data processing. Therefore, 
multi-service access devices that are statically optimized for data traffic processing, typically 
set data traffic processing as the highest scheduling priority to the detriment of voice traffic 
processing. 

A disadvantage of current multi-access service devices is that they are statically 
optimized in favor of either voice or data traffic or are optimized by attempting to pick a 
middle ground to make the best compromise between voice and data traffic (and are thus sub- 
optimal for both). For example, current multi-access service devices statically allocate 
predetermined percentages of bandwidth, CPU processing, and memory or cache memory to 
favor certain types of data traffi c or v oice t raffic over other types of data traffic. Also, as 
previously discussed, current multi-access service devices statically set favored types of data 
traffic or voice traffic to have the highest scheduling priority. Unfortunately, these multi- 
access service devices operate optimally for one type of traffic mix (data or voice) but as 
soon as the traffic mix changes they operate sub-optimally. Additionally, some types of 
multi-access service devices have been designed that utilize a single static optimization based 
on the expected traffic mix, as well as, designed to allow the customer to re-configure and re- 
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optimize the operation of the multi-access service device for different expected traffic mixes. 
However, all these solutions require advanced knowledge of the traffic mix and do not 
res pond toJhe_.dynam^ic^tra ffi pattems ^experienced by a multi-access service device in a real 
world operating environment. 
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The present invention provides for the dynamic optimization of a muUi-service access 
device in response to the current mix of data traffic being presented to the access device. The 
access device includes an analyzer and an optimizer. The analyzer is used to analyze a 
current mixture of a plurality of different data traffic types to create analyzer data. The 
optimizer is coupled to the analyzer. The optimizer is used to optimize.system^ parameters of 
the access device, based^ upon the analvzer dat a, such that the access device is continuously 
dynamically optimized in response to the changing mixtures of the different data traffic types 
presented to the access device. 

In one embodiment, the analyzer includes a plurality of data taps, in which, each data 
tap is associated with a particular data traffic type to acquire information about that particular 
data traffic type. Further, the optimizer includes an optimizing processing unit to process the 
analyzer data received from the analyzer. The optimizer uses the analyzer data to generate 
optim ized systgm parameter s for the cor e processing engine of the access device such that the 
access device is dynamically optimized in response to changing mixture s of different data 
traffic types. Moreover, the optimizer can include an optimizing database that includes 
optimized system parameters to achieve a desired goal for different mixtures of data traffic 
types. The optimized system parameters can include such parameters as: scheduling priority, 
queue size, CPU allocation, cache memory allocation, discard priority, and message size. Of 
course, further optimized system parameters are also possible. 

For example, when the access device is operating at night, the desired goal may be to 
favor a certain type of data traffic, e.g. for large file transfers, to take advantage of large 
amounts of uninterrupted processing time to thereby efficiently process large volumes of data 
traffic. This allows the access device to process this type of data traffic with very high 
throughput by taking advantage of high speed cache memory and uninterrupted CPU 
processing time to perform repetitive operations. Thus, in this instance, the optimized system 
parameters are set such that the scheduling priority for this type of data traffic is set to a high 
value, the queue size for this type of data traffic is set to a high value, CPU allocation for this 
type of data traffic is set to a large value, cache memory allocation for this type of traffic is 
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set to a large value, and the discard priority for other types of data traffic is set to a high 
value. 



However, assuming a number of voice calls suddenly need to be processed by the 
access device and that a desired goal is that voice calls have a higher priority than data traffic, 
the access device can suddenly switch to be dynamically optimized for voice calls. In this 
instance, the optimized system parameters can be changed such that the scheduling priority ^ 



for the voice traffic is set to a high value jqueue size for the voice traffic is set to a small 
valu^ CPU allocation for the voice traffic is set to a large value, and the discard priority for 
the other types of data traffic is set to a high value. Accordingly, the access device is 
dynamically optimized to favor voice traffic so that the voice traffic is more likely to get 
through reliably without delay or latency, while putting off the data traffic that can be 
processed at a later time. Thus, the access device is dynamically optimized to respond to the 
changing mixtures of data traffic types. 

Moreover, the present invention can be used with an access device already having a 
fixed hardware configuration to support increased data traffic throughput at higher quality 
levels than access devices not using the invention. Accordingly, lower cost access devices 
using the present invention can provide the same performance as higher cost access devices 
resulting in significant cost savings. 

Other features and advantages of the present invention will be set forth in part in the 
description which follows and the accompanying drawings, wherein the preferred 
embodiments of the present invention are described and shown, and in part will become 
apparent to those skilled in art upon examination of the following detailed description taken 
in conjunction with the accompanying drawings, or may be learned by the practice of the 
present invention. The advantages of the present invention may be realized and attained by 
means of the instrumentalities and combinations particularly pointed out in the appended 
claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
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The features and advantages of the present invention will become apparent from the 
following detailed description of the present invention in which: 

Figure 1 shows a voice and data communication system in which one embodiment of 
the present invention can be practiced. 

Figure 2 is a block diagram illustrating a multi-service access device of Figure 1 in 
concentrator form according to one embodiment of the present invention. 

Figure 3 is a block diagram illustrating an optimizer of the multi-service access device 
according to one embodiment of the present invention. 

Figure 4 is a block diagram illustrating an example of a core processing engine of the 
multi-service access device processing an exemplary set of data traffic according to one 
embodiment of the present invention. 

Figure 5 is a table illustrating three different examples of how a multi-service access 
device can optimize system parameters of the core processing engine for exemplary sets of 
data traffic and the processes shown in Figure 4, to achieve a desired goal, according to one 
embodiment of the present invention. 

Like reference numbers and designations in the drawings indicate like elements 
providing similar functionality, A letter or prime after a reference number designator 
represents another or different instance of an element having the reference number 
designator. 
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The present invention provides for the dynamic optimization of a multi-service access 
device in response to the current mix of data traffic being presented to the access device. The 
access device includes an analyzer and an optimizer. The analyzer is used to analyze a 
current mixture of a plurality of different data traffic types to create analyzer data. The 
optimizer is coupled to the analyzer. The optimizer is used to optimize system parameters of 
the access device, based upon the analyzer data, such that the access device is continuously 
dynamically optimized in response to the changing mixtures of the different data traffic types 
presented to the access device. 

In the following description, the various embodiments of the present invention will be 
described in detail. The description will include certain details such as the type of data being 
transmitted and the protocols used. However, such details are included to facilitate 
understanding of the invention and to describe exemplary embodiments for implementing the 
invention. Such details should not be used to limit the invention to the particular 
embodiments described because other variations and embodiments are possible while staying 
within the scope of the invention. Furthermore, although numerous details are set forth in 
order to provide a thorough understanding of the present invention, it will be apparent to one 
skilled in the art that these specific details are not required in order to practice the present 
invention. In other instances details such as, well-known methods, types of data, protocol, 
procedures, components, electrical structures and circuits, are not described in detail, or are 
shown in block diagram form, in order not to obscure the present invention. Furthermore, the 
present invention will be described in particular embodiments but may be implemented in 
hardware, software, firmware, middleware, or a combination thereof. 

In alternative embodiments, the present invention may be applicable to 
implementations of the invention in integrated circuits or chip sets, switching systems 
products and transmission systems products. For purposes of this application, the terms 
switching systems products shall be taken to mean private branch exchanges (PBXs), central 
office switching systems that interconnect subscribers, toll/tandem switching systems for 
interconnecting trunks between switching centers, and broadband core switches found at the 
center of a service provider's network that may be fed by broadband edge switches or access 
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multiplexers, and associated signaling, and support systems and services. The term 
transmission systems products shall be taken to mean products used by service providers to 
provide interconnection between their subscribers and their networks such as loop systems, 
and which provide multiplexing, aggregation and transport between a service provider's 
switching systems across the wide area, and associated signaling and support systems and 
services. 

In the following description, certain terminology is used to describe various features 
of the present invention. In general, a "communication system" comprises one or more end 
nodes having physical connections to one or more networking devices of a network. More 
specifically, a "networking device" comprises hardware and/or software used to transfer 
information through a network. Examples of a networking device include a multi-access 
service device, a router, a switch, a repeater, or any other device that facilitates the 
forwarding of information. An "end node" normally comprises a combination of hardware 
and/or software that constitutes the source or destination of the information. Examples of an 
end node include a Local Area Network (LAN), Private Branch Exchange (PBX), telephone, 
fax machine, video source, computer, printer, workstation, application server, set-top box and 
the like. "Data traffic" generally comprises one or more signals having one or more bits of 
data, address, control or any combination thereof transmitted in accordance with any chosen 
packeting scheme. "Data traffic" can be data, voice, address, and/or control in any 
representative signaling format or protocol. A "link" is broadly defined as one or more 
physical or virtual information-carrying mediums that establish a communication pathway 
such as, for example, optical fiber, electrical wire, cable, bus traces, wireless channels (e.g. 
radio, satellite frequency, etc.) and the like. 

Figure 1 shows a voice and data communication system 1 00 in which one 
embodiment of the present invention can be practiced. The communication system 100 
includes a computer network (e.g. a wide area network (WAN) or the Internet) 102 which is a 
packetized or a packet-switched network that can utilize Internet Protocol (IP), Asynchronous 
Transfer Mode (ATM), Frame Relay (FR), Point-to Point Protocol (PPP), Systems Network 
Architecture (SNA), Voice over Internet Protocol (VoIP), or any other sort of protocol. The 
computer network 102 allows the communication of data traffic, e.g. voice/speech data and 
other types of data, between any end nodes 104 in the communication system 100 using 
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packets. Data traffic through the network may be of any type including voice, graphics, 
video, audio, e-mail. Fax, text, multi-media, documents and other generic forms of data. The 
computer network 1 02 is typically a data network that may contain switching or routing 
equipment designed to transfer digital data traffic. At each end of the communication system 
5 100 the voice and data traffic requires packetization when transceived across the network 
102, 

The communication system 100 includes networking devices, such as multi-service 
access devices 108 A and 108B, in order to packetize data traffic for transmission across the 
computer network 102. A multi-service access device 108 is a device for connecting multiple 
10 networks and devices that use different protocols and also general ly include ^jmtchiiig,and. 
routiq g func tions. Access devices 108 A and 108B are coupled together by network links 1 10 
and 112 to the computer network 102. 

Voice traffic and data traffic may be provided to a multi-service access device 1 08 
from a number of different end nodes 104 in a variety of digital and analog formats. For 

1 5 example, in the exemplary environment shown in Figure 1 , the different end nodes include a 
computer/workstation 120, a telephone 122, a LAN 124, a PBX 126, a video source 128, and 
a fax machine 130 connected via links to the access devices. However, it should be 
appreciated any number of different types of end nodes can be connected via links to the 
access devices. In the communication system lOO^digitalvoice, fax, and modem traffic are 

20 transceived at PBXs 126 A and 126B which can be coupled to multiple analog or digital 

telephones, fax machines, or data modems (not shown). Particularly, the digital voice traffic 
can be transceived with access devices 108 A and 108B, respectively, over the computer 
packet network 102. Moreover, other data traffic from the other end nodes: 
computer/workstation 120 (e.g. TCP/IP traffic), LAN 124, and video 128, can be transceived 

25 with access devices 108 A and 108B, respectively, over the computer packet network 102. 

Also, analog voice and fax signals from telephone 122 and fax machine 130 can be 
transceived with multi-service access devices 108 A and 108B, respectively, over the 
computer packet network 102. The access devi ces 108 convert the a nalogvoice and fax 
si gnals to voice/fax digital data traffic, assemble the _voiceZfax,digitaLdata ^affic into p ackets, 
30 and send the packets over the computer packet network 1 02. 
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Thus, packetized data traffic in general, and packetized voice traffic in particular, can 
be transceived with multi-service access devices 108 A and 108B, respectively, over the 
computer packet network 102. Generally, the access device 108 pa cketizes the information 
receivedjr om a source end riode 10 4 for tra nsmission across the ,99gjPj£ter p acket network 
5 102. Usually, each packet contains the target address, which is used to direct the packet 
through the computer network to its intended destination end node. Once the packet enters 
the computer network 102, any number of networking protocols, such as TCPAP, ATM, FR, 
PPP, SNA, VoIP, etc., can be employed to carry the packet to its intended destination end 
node. The packets are generally sent from a source access device to a destination access 
10 device over a virtual paths or a connection established between the access devices. The 

access devices are usually responsible for negotiating and establishing the virtual paths are 
f J connections. Data and voice traffic r eceived by the access devices from the computer 

j^; network are d_epacketized and decoded for distribution to the appropriate destination end 

yj node. It should be appreciated that the Figure 1 environment is only exemplary and that the 

1 5 present invention can be used with any type of end nodes, computer networks, and protocols. 

Figure 2 is a block diagram illustrating a multi-service access device of Figure 1 in 
!: concentrator form according to one embodiment of the present invention. The present 

nJ invention provides for the dynamic optimizatigji^ofa multi-s ervice acce ssjdeyiceU.Q8 in 

response to the current mix of data traffic being presented to the access device. As shown in 
20 Figure 2, the access device 108 receives a current mixture of a plurality of different data 
traffic types from a plurality of different end nodes 1 04 as well as other data traffic inputs 
from the computer network 102 via network link 110. Further, the access device 108 
receives local voice traffic and data traffic from the different end nodes 104 in a variety of 
digital and analog formats. Particularly, as shown in this example, the access device receives 
25 different data traffic types from computer/workstation 120, telephone 122, LAN 124, PBX 
126, video source 128, and fax machine 130 connected via links to the access device. For 
example, the access device receives digital voice, fax, and modem data traffic from PBX 126, 
TCP/IP data traffic from computer/workstation 120, analog voice signals from telephone 122, 
analog fax signals from fax machine 130, video data traffic from video source 128, LAN data 
30 traffic from LAN 124, as well as, a number of other data traffic inputs such as ATM data 
traffic 140, FR data traffic 142, PPP data traffic 144, SNA data traffic 146, and VoIP data 
traffic 148. Moreover, the access device 108 recei ves voice traffic and data traf ficjor^the 
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local end nodes 104 from other end nodes across the computer network 102, as well as for 
other processing, via network link 110 in IP, ATM, FR, PPP, SNA, VoIP, etc., formats. It 
should be appreciated that these are only exemplary data traffic inputs and the present 
invention can be utilized with any set of data traffic inputs. 

In one embodiment of the present invention, the access device 108 includes an 
analyzer 210, a core processing engine 230, and an optimizer 240. The analyzer 210 is used 
to analyze the 



mixtures of th 



current mixtur the plurality of different data traffic types and to create 



analyzer data. The optimizer 240 is coupled to the analyzer 210. The analyzer 210 provides 



the analyzer data to the optimizer 240. As will be discussed, the optimizer 240 is used to 
1 0 0£timiz£S3^stem^p^ based upon the analyzer data, such that 

the access device is contin uously dyna mically optimized in response to the ch anging^mixtures^ 
of the different data traffic types presentedh:_o tfLe aicce^s^^ 

As shown in Figure 2, the analyzer 210 includes a first analyzer 212 and a second 
analyzer 214. The first analyzer 21^2analyzes the current mixture of the plurality of different 
1 5 data traffic types fi:om the end nodes 104 and other data traffic inputs 140-148, The first 

analyzer 212 analyzes the current mixture to create a set of first analyzer data that it transmits 
to the optimizer 240. The ^se_Q Qjid, analvzer 214 analyzes the current mixture of the plurality 
of different data traffic <^y pes received from theTomputer netwo r k 102 ^ a network link 110. 



Likewise, the second analyzer 214 analyzes the current mixture to create a set of second 
20 analyzer data that it also transmits to the opt imizer 240. 

The first and the second analyzer 212 and 214 each include a plurality of data taps 
21 6i_N and 21 Si-n, respectively. Each data tap is associated with a particular data traffic type 
to acquire information about that particular data traffic type. The first analyzer 212 has a 
plurality of data taps 216i.n each of which is associated with a link from one of the end nodes 

25 104 (e.g. computer/workstation 120, telephone 122, PBX 126, LAN 124. video 128, fax 
machine 130) and the links from the other data traffic inputs (e.g. ATM, FR, PPP, SNA, 
VoIP) 140-148, respectively. The second analyzer 214 likewise has a plurality of data taps 
2I81.N each of which is associated with a given channel of the network Hnk 1 10 that carries a 
particular type of data traffic format/protocol or data traffic type (e.g. IP, ATM, FR, Video, 

30 LAN, PPP, SNA, VoIP, Voice, Fax). The data taps can be used to acquire information 
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regarding, for example, packet type, packet size, class of service, priority, and the packet flow 



rate for each particular data trafficType\ However, it should be appreciated that the data taps 
can be used to acquire a myriad of other types of information for various data traffic types. 

The data taps provide a non-intrusive method by which the access device 108 can measure 

/ ■ ■ — 

the types of data traffic flowing into and out of the access device. 



The first and the second analyzer 212 and 214 also each include an analyzer 
processing unit 220 and 222, respectively. The analyzer processing units 220 and 222 
process information about the different data traffic types based upon the acquired information 
from the data taps 216i-n and 218i_n to generate first and second analyzer data, respectively, 
10 which is forwarded onto the optimizer 240. Thus, the analyzer processing units in 

conjunction with the data taps generate first and second analyzer data, respectively, such as 
[fk the packet flow rate and the packet size for each particular data traffic type to provide the 

""'"^ access d^vicej^,-and the optimizer S4Q"tn)i parti c^i lar^with a representation of the current 

J] mixture of different data traffic types flowing^into and out of the access device. 

W 15 The core processing engine 230 of the multi-service access device 108 includes, in 

^ this example, a central processing unit (CPU) 232 having a high speed cache memory 233, a 

memory 234 which may also include cache memory 235, a first bus 236 connecting the links 

h s • 

of the end nodes 104 and other data traffic inputs 140-148 to the core processing engine, and 
2f a second bus 237 connecting the network link 1 10 from the computer network 102 to the core 

Cj 20 processing engine. The core processing engine 230^ut^^xsi^ associat ed software perfor ^^^ 

functions such as switching, routing, processing^t^^^oritizing datajfraffic f^w|^ 



common 

packetizing, depacketizing, etc., associated with typtealfnulti-service access devices. Of 
course, the core processing engine 230 may also include other functionality and associated 
functional blocks, which are not shown herein so as not to obscure the present invention. It 
25 should be appreciated that core processing engines are well known in the art. 

The optimizer 240 is used to optimize system garamgtersj^h^j^re 
^^ne 230 o f the access device 108, based^uporUhe^fk and second analyzer data from the 
first and second analyzer 212 and 214jj:espectively, such that the access device is 
continuously dynamically optimized in response to the changing mixtures of the different 
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data traffic types presented to the access devicQ^fi ^m both the end no3^^ 4 and other data 
traffic inputs 140-148 and from the computer network 102. 

Figure 3 is a block diagram illustrating an optimizer of the multi-service access device 
according to one embodiment of the present invention. As shown in Figure 3, the optimizer 
5 240 includes an optimizing processing unit 242 to process the first and second analyzer data 
from the first and second analyzer, respectively. The optimizing processing unit 242 
generates optimized system parameters for the core ^roces sjng^ngine. The optimized system 
parameters are transmitted to the core processing engine of the access device such that the 
access device is continuously dynamically optimized in response to changing mixtures of 
10 different data traffic types. 

The optimizer 240 may also include an optimizing database to 244 that is coupled to jf- 
the optimizing processing unit 242. The optimizing database includes optimized system ^ 
parameters for different mixtures of data traffic types to achieve a desired goal. The / ^. r*"*" af» . , 

optimized system parameter can include such parameters as: scheduling priority] queue sizei 0^ . J^*'^ 

. _ , — ' ^ ^ .^^.^yj^^^^,<::^^ 

yj 1 5 CPU allocation, cache mem_ory_alJbcatjon^^ bandwidth ^ *^ csAP^ 

U ^ ' ~ ' ' ^^^^ ^ 

\ allocation, scheduling granularity, ca che sizes, and conte nfe^ The optimizer 24(Janay be 

programmed with a multitude of desired goals. For example, a desired goal may be to favor a 

certain type of data traffic at night (e.g. for large file transfers), over other types of data traffic 



(e.g. Voice, TCP/IP, FR, etc.) to take advantage of large amounts of uninterrupted processing 
20 time to thereby efficiently process large volumes of data. As another example, the desired 
goal may be to favor a cert ain type of data traffic ( e.g. financial transaction data traffic via 
SNA) over all other types of traffic at night, except voice, such that voice is the data traffic 
with the highest priority. Thus during the prcicessing^ if a 

number of voice calls suddenly need to be processed by the access device, the access device 
25 can be dynamically optimized for voice calls. It should be appreciated that an infinite 
number of desired goals for different data traffic types being favored over other types of 
different data traffic types under a multitude of different conditions (e.g. time of day, week, 
financial market conditions, etc.) can be programmed into the optimizer. 

The optimizing processing unit 242 com pares the des,ired goal to the first^nd^cond 
30 analyzer data, which provide the current state of the access device (i.e. the data traffic flow 
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for each data traffic type into and out of the access device), and based on the comparison, the 
optimizing database 244 pr ovides optimized system parameters to the optimizing processing 
unit 242. The optimizing processing unit 242 processes these optimized system parameters 
and transmits the optimized system parameters to the core processing engine to achieve the 
desired goal. The optimizing database 244 can be a simple look up table, a knowledge base, 
a neural network, or any sort of database or algorithm, to generate and store optimized system 
parameter settings correlated to the state of the access device and the desired goals for the 
access device. 

Thus, if a particular type of data traffic^ is present,..andtfia|^pa]^^ of data 

traffic is set to the highest priority relative to other data tra ffic types, then^gtimized^sy^^ 
parameters are sent to the core process ing engine to favor the processin g of that particular 
type of data traffic over othg ^data. traf flctypes . As a particular example, if voice traffic is 
^present and is the highest priority relative to other data traffic types, then optimized system 
parameters are s ent~to"the"core process favor the processing of voice traffic. 

Accordingly, the access device utilizing the analyzer and the optimizer creates a dynamic 
feedback loop that constantly and instantaneously, dependent upon the data traffic that the 
analyzer is looking at and the desired goal, d ynamica | ]y_chg^g es tii^^^ optigiizgd^y s tgn^ 
vparameter ^sent^tg ^e^ore processing en ginejo achieve the_dg.sjjGed^Q.^^^ that the_access 
^device is continuously dynamically optimized in response4o4he-Ghanging,rnixto of the 
different data jtraffic j ypes^ presented to the access device. 

Figure 4 is a block diagram illustrating an example of the core processing engine of 
the multi-service access device processing an exemplary set of data traffic according to one 
embodiment of the present invention. As shown in Figure 4, a first input queue of data traffic 
402 from one of the end nodes or other data traffic inputs is received by the access device. 
The first input queue of data traffic 402 is measured by one of the data taps 216i.n of the first 
analyzer 212, analyzed by the first analyzer 212, and first analyzer data is transmitted to the 
optimizer. The first input queue of data traffic 402 next undergoes Process I of the core 
processing engine 230 resulting in a third queue of data traffic 404. The third queue of data 
traffic 404 then undergoes Common Process 3 (along with a fourth queue 412 of data traffic) 
and is transmitted out of the core processing engine as a fifth queue of data traffic 406 along 
network link 1 10 to the computer network 102. The fifth queue of data traffic 406 is also 
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measured by one of the data taps 218i.n of the second analyzer 214, analyzed by the second 
analyzer 214, and second analyzer data is transmitted to the optimizer. 

Concurrently, a second input queue of data traffic 4 1 0 from one of the end nodes or 
other data traffic inputs is received by the access device. The second input queue of data 
5 traffic 410 is measured by one of the data taps 216i_n of the first analyzer 212, analyzed by 
the first analyzer 212, and first analyzer data is transmitted to the optimizer. The second 
input queue of data traffic 410 next undergoes Process 2 of the core processing engine 230 
resulting in a fourth queue of data traffic 412. The fourth queue of data traffic 412 then 
undergoes Common Process 3 (along with the third queue of data traffic 404) and is 
10 transmitted out of the core processing engine as a fifth queue of data traffic 406 along 

network link 1 10 to the computer network 102. The fifth queue of data traffic 406 is also 
measured by one of the data taps 218i.n of the second analyzer 214, analyzed by the second 
analyzer 214, and second analyzer data is transmitted to the optimizer. As previously 



discussed, the optimizer 240 compares a desired goal to thAfirst and se cond a nalyzer data,^'^^"^^^^^ 



"'i 1 5 which provide the current state of the access device (i.e. the data traffic flow for each data 



traffic type into and out of the access device), and based on the comparison^ the optimizer 



240 provides optimized system parameters to the core processiBg-Cjagine 230 to achieve the 



f| I desired goal for the different types of data traffic currently being processed by the core 

processing engine. 

Oj 

zt 20 Figure 5 is a table illustrating three different examples of how the multi-service access 

device of the present invention (constructed as described above) can optimize system 
parameters of the core processing engine for exemplary sets of data traffic and the processes 
shown in Figure 4, to achieve a desired goal, according to one embodiment of the present 
invention. Each row of the table in Figure 5 represents the specific optimizations for a class 
25 of data with the order of the rows determining the priority of the data. With reference to 

Figure 5, in conjunction with Figure 4, some examples of how the access device can optimize 
system parameters of the core processing engine to achieve a desired goal will be discussed. 

For example, as shown in Row 2, a desired goal may be to favor financial transaction 
data traffic (via SNA), over Internet data traffic (via TCP/IP), during the day, to efficiently 
30 process high priority financial traffic data. In this way, the optimizations have been set to 
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favor the financial transactions over say workers using the Internet for undesirable non-work 
related web surfing. 

The second input queue of data traffic 402 for financial data transactions is set to a 
large value for high throughput through the core processing engine 230. Process 2 (e.g. 
5 analysis of the financial data) is set to have a high scheduling priority, a large CPU allocation 
for the greatest amount of processing, and a large cache memory allocation to take advantage 
of high speed cache memory. The output of Process 2, the fourth queue of data traffic 412 
(e.g. the analyzed financial data), is likewise is set to a large value, for high throughput 
through the core processing engine 230. The fourth queue of data traffic 412 then undergoes 
10 Common Process 3 (e.g. packetization into a suitable protocol for transmission over computer 
network 102, along with the other queues of data traffic). Similarly, Common Process 3 is 
set to have a high scheduling priority, a large CPU allocation for the greatest amount of 
'^4 processing, and a large cache memory allocation to take advantage of high speed cache 

^4 memory. Also, Common Process 3 favors queue 4 and a discard threshold can be set such 

"'J 15 that if congestion occurs in the access device, the other queue of data traffic (e.g. Internet 

yi 

Tl traffic) is discarded. The commonly processed fourth queue of data traffic 412 is transmitted 

" out of the core processing engine as a (e.g. packetized) fifth queue of data traffic 406 along 

n I network link 1 10 to the computer network 102. 

OS On the other hand, the first input queue of data traffic 402 currently handling the less 

20 important Internet traffic (via TCP/IP) is likewise set to a large value for high throughput 

through the core processing engine 230. However, Process 1 (e.g. analysis of the IP data) is 
set to a low scheduling priority, a small CPU allocation for a smaller amount of processing, 
and a small cache memory allocation. The output of Process 1 , the third queue of data traffic 
404 (e.g. the analyzed IP data), is likewise set to a large value for high throughput through the 
25 core processing engine 230. The third queue of data traffic 404 then undergoes Common 

Process 3 (e.g. packetization into a suitable protocol for transmission over computer network 
102, along with the fourth queue of data traffic). The commonly processed third queue of 
data traffic 404 is transmitted out of the core processing engine as a (e.g. packetized) fifth 
queue of data traffic 406 along network Hnk 1 10 to the computer network 102. 
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The above example described the optimizations for two specific types of traffic 
flowing through the core processing engine. The dynamic nature of this invention is 
illustrated by the change of the nature of the data flowing. Row 1 of the table in Figure 5 
identifies that Voice calls are to be given the highest priority and lowest latency in the 
5 system. If, during the processing of the data streams described above a voice call is made 
and the Voice packets arrive via the first input queue 402, the Analyzer 2 1 2 wilMetect the _ 
presencejpf Voice p ackets via ^onej^Xthg datajaps^l6. jj iis informati o n will be sentJ o_tfie^ 
Optim iggi^Cnot shown in Figure 4) which will use the parameters stored in Ro w 1 of the table 
in^Figure 5 t o d>aiaimcally,r^^ Engi ne 230 to give^rioi ^ to 

1 0 Voice packets. 

Specifically, the following changes will be made. Processl(i^. for th e pro cessing o f 
voice traffic) will be given a higher priority t han P ro cess 2 (i.e . for the processing of financial 
\j data traffic), as well as, a large CPU allocation for the greatest amount of processing and a 

'^ll large cache memory allocation to take advantage of high speed cache memory. In contrast, 

' 1 5 Pr ocess 2 is cha nged^t ojiave a low scheduling priority, a small CPU allocation, and a small 
cache memory allocation. Process 2 will further be restricted to very small time slices to 
prevent it from blocking work needing to be done by Process 1 . As before. Common Process 
3 is set to have a high scheduling priority, a large CPU allocation, and a large cache memory 
allocation. However, common Process 3 will be instgijate4J;Qjvgw favor the input of the third 




20 queue 404 over that of the fourth j3.ugVLe 412 an'^S^QQngesti<^^^^urs in the access device, the 



fourth queue of data traffic will be discarded. Moreover, the queue lengths in the first and 



third queues 402 and 404 (i.e. voice traffic) will be set to low values to reduce latency 
whereas the queue lengths for the second and fourth queues 410 and 412 (i.e. financial data 
traffic) remain large. The net result of these changes is to change the core processing engijie 
25 from one optimized to process a high throughput of fi nancial data t raffic to one op timized for 
low latency voice. 

Once the voice call ha s been complet ed, the Analyzer 212, via one of the data taps 
2 1 6, ijolonger^rgp^ggs^the-presence of Voic e Packe ts to the Optimizer and the optimizer then 



_Q nggjigain consujts^the ta ble in Figure 5 to determine ht>M Lthe cor e^rocessing engine 230 
30 should be configured to optimally handle thecurrent mix o f traffic 
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Thus, assuming a number of voice calls suddenl y need t o be pro cessed t)y_the access 



device and that a desired goal is that voice calls have a high priority, the access device can 



suddenly switch to be dynamically optimized for voice calls. In this instance, the optimized 
L system parameters can be dynamically changed to favor voice traffic over financial 

Cr*^ ^ transaction data traffic. Accordingly, the access device is dynamically optimized to favor 
voice traffic so that the voice traffic is more likely to get through reliably without delay or 
latency, while putting off the financial transaction data traffic that can be processed at a later 
C (y^^ tiiTie. Thus, the access device is dynamically optimized to respond to the changing mixtures 
of data traffic types. Moreover, it should be appreciated that an infinite number of desired 



10 ^ goals for different data traffic types being favored over other types of different data traffic 
types under a multitude of different conditions (e.g. time of day, week, financial market 



conditions, etc.) can be implemented. 

^'^J J "^^j^^ ^ Another advantage of the present invention is that it can be used with an access device 
already having a fixed hardware configuration to support increased data traffic throughput at 
1 5 higher quality levels than access devices not using the invention. Accordingly, lower cost 
access devices using the present invention can provide the same performance as higher cost 
access devices resulting in significant cost savings. 



nJ 



While the present invention and its various functional components have been 
described in particular embodiments, it should be appreciated the present invention can be 

20 implemented in hardware, software, firmware, middleware or a combination thereof and 
utilized in systems, subsystems, components, or sub-components thereof. When 
implemented in software, the elements of the present invention are the instructions/code 
segments to perform the necessary tasks. The program or code segments can be stored in a 
machine readable medium, such as a processor readable medium or a computer program 

25 product, or transmitted by a computer data signal embodied in a carrier wave, or a signal 

modulated by a carrier, over a transmission medium or communication link. The machine- 
readable medium or processor-readable medium may include any medium that can store or 
transfer information in a form readable and executable by a machine (e.g. a processor, a 
computer, etc.). Examples of the machine/processor-readable medium include an electronic 

30 circuit, a semiconductor memory device, a ROM, a flash memory, an erasable programmable 
ROM (EPROM), a floppy diskette, a compact disk CD-ROM, an optical disk, a hard disk, a 
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fiber optic medium, a radio frequency (RF) link, etc. The computer data signal may include 
any signal that can propagate over a transmission medium such as electronic network 
channels, optical fibers, air, electromagnetic, RF links, etc. The code segments may be 
downloaded via computer networks such as the Internet, Intranet, etc. 

While certain exemplary embodiments have been described and shown in the 
accompanying drawings, it is to be understood that such embodiments are merely illustrative 
of and not restrictive on the broad invention, and that this invention not be limited to the 
specific constructions and arrangements shown and described, since various other 
modifications may occur to those ordinarily skilled in the art. 
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